Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

Confirmation bias in the utilization of others' opinion strength

Humans tend to discount information that undermines past choices and judgments. This confirmation bias has significant impact on domains ranging from politics to science and education. Little is known about the mechanisms underlying this fundamental characteristic of belief formation. Here we report a mechanism underlying the confirmation bias. Specifically, we provide evidence for a failure to use the strength of others' disconfirming opinions to alter confidence in judgments, but adequate use when opinions are confirmatory. This bias is related to reduced neural sensitivity to the strength of others' opinions in the posterior medial prefrontal cortex when opinions are disconfirming. Our results demonstrate that existing judgments alter the neural representation of information strength, leaving the individual less likely to alter opinions in the face of disagreement

Prioritized memory access explains planning and hippocampal replay.

To make decisions, animals must evaluate candidate choices by accessing memories of relevant experiences. Yet little is known about which experiences are considered or ignored during deliberation, which ultimately governs choice. We propose a normative theory predicting which memories should be accessed at each moment to optimize future decisions. Using nonlocal 'replay' of spatial locations in hippocampus as a window into memory access, we simulate a spatial navigation task in which an agent accesses memories of locations sequentially, ordered by utility: how much extra reward would be earned due to better choices. This prioritization balances two desiderata: the need to evaluate imminent choices versus the gain from propagating newly encountered information to preceding locations. Our theory offers a simple explanation for numerous findings about place cells; unifies seemingly disparate proposed functions of replay including planning, learning, and consolidation; and posits a mechanism whose dysfunction may underlie pathologies like rumination and craving

Lateral orbitofrontal cortex anticipates choices and integrates prior with current information

Adaptive behavior requires integrating prior with current information to anticipate upcoming events. Brain structures related to this computation should bring relevant signals from the recent past into the present. Here we report that rats can integrate the most recent prior information with sensory information, thereby improving behavior on a perceptual decision-making task with outcome-dependent past trial history. We find that anticipatory signals in the orbitofrontal cortex about upcoming choice increase over time and are even present before stimulus onset. These neuronal signals also represent the stimulus and relevant second-order combinations of past state variables. The encoding of choice, stimulus and second-order past state variables resides, up to movement onset, in overlapping populations. The neuronal representation of choice before stimulus onset and its build-up once the stimulus is presented suggest that orbitofrontal cortex plays a role in transforming immediate prior and stimulus information into choices using a compact state-space representation

The Neural Representation of Prospective Choice during Spatial Planning and Decisions

We are remarkably adept at inferring the consequences of our actions, yet the neuronal mechanisms that allow us to plan a sequence of novel choices remain unclear. We used functional magnetic resonance imaging (fMRI) to investigate how the human brain plans the shortest path to a goal in novel mazes with one (shallow maze) or two (deep maze) choice points. We observed two distinct anterior prefrontal responses to demanding choices at the second choice point: one in rostrodorsal medial prefrontal cortex (rd-mPFC)/superior frontal gyrus (SFG) that was also sensitive to (deactivated by) demanding initial choices and another in lateral frontopolar cortex (lFPC), which was only engaged by demanding choices at the second choice point. Furthermore, we identified hippocampal responses during planning that correlated with subsequent choice accuracy and response time, particularly in mazes affording sequential choices. Psychophysiological interaction (PPI) analyses showed that coupling between the hippocampus and rd-mPFC increases during sequential (deep versus shallow) planning and is higher before correct versus incorrect choices. In short, using a naturalistic spatial planning paradigm, we reveal how the human brain represents sequential choices during planning without extensive training. Our data highlight a network centred on the cortical midline and hippocampus that allows us to make prospective choices while maintaining initial choices during planning in novel environments

Induction of cell cycle changes and modulation of apoptogenic/anti-apoptotic and extracellular signaling regulatory protein expression by water extracts of I'm-Yunity™ (PSP)

BACKGROUND: I'm-Yunity™ (PSP) is a mushroom extract derived from deep-layer cultivated mycelia of the patented Cov-1 strain of Coriolus versicolor (CV), which contains as its main bioactive ingredient a family of polysaccharo-peptide with heterogeneous charge properties and molecular sizes. I'm-Yunity™ (PSP) is used as a dietary supplement by cancer patients and by individuals diagnosed with various chronic diseases. Laboratory studies have shown that I'm-Yunity™ (PSP) enhances immune functions and also modulates cellular responses to external challenges. Recently, I'm-Yunity™ (PSP) was also reported to exert potent anti-tumorigenic effects, evident by suppression of cell proliferation and induction of apoptosis in malignant cells. We investigate the mechanisms by which I'm-Yunity™ (PSP) elicits these effects. METHODS: Human leukemia HL-60 and U-937 cells were incubated with increasing doses of aqueous extracts of I'm-Yunity™ (PSP). Control and treated cells were harvested at various times and analyzed for changes in: (1) cell proliferation and viability, (2) cell cycle phase transition, (3) induction of apoptosis, (4) expression of cell cycle, apoptogenic/anti-apoptotic, and extracellular regulatory proteins. RESULTS: Aqueous extracts of I'm-Yunity™ (PSP) inhibited cell proliferation and induced apoptosis in HL-60 and U-937 cells, accompanied by a cell type-dependent disruption of the G(1)/S and G(2)/M phases of cell cycle progression. A more pronounced growth suppression was observed in treated HL-60 cells, which was correlated with time- and dose-dependent down regulation of the retinoblastoma protein Rb, diminution in the expression of anti-apoptotic proteins bcl-2 and survivin, increase in apoptogenic proteins bax and cytochrome c, and cleavage of poly(ADP-ribose) polymerase (PARP) from its native 112-kDa form to the 89-kDa truncated product. Moreover, I'm-Yunity™ (PSP)-treated HL-60 cells also showed a substantial decrease in p65 and to a lesser degree p50 forms of transcription factor NF-κB, which was accompanied by a reduction in the expression of cyclooxygenase 2 (COX2). I'm-Yunity™ (PSP) also elicited an increase in STAT1 (signal transducer and activator of transcription) and correspondingly, decrease in the expression of activated form of ERK (extracellular signal-regulated kinase). CONCLUSION: Aqueous extracts of I'm-Yunity™ (PSP) induces cell cycle arrest and alterations in the expression of apoptogenic/anti-apoptotic and extracellular signaling regulatory proteins in human leukemia cells, the net result being suppression of proliferation and increase in apoptosis. These findings may contribute to the reported clinical and overall health effects of I'm-Yunity™ (PSP)

Iron Behaving Badly: Inappropriate Iron Chelation as a Major Contributor to the Aetiology of Vascular and Other Progressive Inflammatory and Degenerative Diseases

The production of peroxide and superoxide is an inevitable consequence of aerobic metabolism, and while these particular "reactive oxygen species" (ROSs) can exhibit a number of biological effects, they are not of themselves excessively reactive and thus they are not especially damaging at physiological concentrations. However, their reactions with poorly liganded iron species can lead to the catalytic production of the very reactive and dangerous hydroxyl radical, which is exceptionally damaging, and a major cause of chronic inflammation. We review the considerable and wide-ranging evidence for the involvement of this combination of (su)peroxide and poorly liganded iron in a large number of physiological and indeed pathological processes and inflammatory disorders, especially those involving the progressive degradation of cellular and organismal performance. These diseases share a great many similarities and thus might be considered to have a common cause (i.e. iron-catalysed free radical and especially hydroxyl radical generation). The studies reviewed include those focused on a series of cardiovascular, metabolic and neurological diseases, where iron can be found at the sites of plaques and lesions, as well as studies showing the significance of iron to aging and longevity. The effective chelation of iron by natural or synthetic ligands is thus of major physiological (and potentially therapeutic) importance. As systems properties, we need to recognise that physiological observables have multiple molecular causes, and studying them in isolation leads to inconsistent patterns of apparent causality when it is the simultaneous combination of multiple factors that is responsible. This explains, for instance, the decidedly mixed effects of antioxidants that have been observed, etc...Comment: 159 pages, including 9 Figs and 2184 reference

Molecular mechanisms of cell death: recommendations of the Nomenclature Committee on Cell Death 2018.

Over the past decade, the Nomenclature Committee on Cell Death (NCCD) has formulated guidelines for the definition and interpretation of cell death from morphological, biochemical, and functional perspectives. Since the field continues to expand and novel mechanisms that orchestrate multiple cell death pathways are unveiled, we propose an updated classification of cell death subroutines focusing on mechanistic and essential (as opposed to correlative and dispensable) aspects of the process. As we provide molecularly oriented definitions of terms including intrinsic apoptosis, extrinsic apoptosis, mitochondrial permeability transition (MPT)-driven necrosis, necroptosis, ferroptosis, pyroptosis, parthanatos, entotic cell death, NETotic cell death, lysosome-dependent cell death, autophagy-dependent cell death, immunogenic cell death, cellular senescence, and mitotic catastrophe, we discuss the utility of neologisms that refer to highly specialized instances of these processes. The mission of the NCCD is to provide a widely accepted nomenclature on cell death in support of the continued development of the field

Pleiotropic Effects of Sox2 during the Development of the Zebrafish Epithalamus

The zebrafish epithalamus is part of the diencephalon and encompasses three major components: the pineal, the parapineal and the habenular nuclei. Using sox2 knockdown, we show here that this key transcriptional regulator has pleiotropic effects during the development of these structures. Sox2 negatively regulates pineal neurogenesis. Also, Sox2 is identified as the unknown factor responsible for pineal photoreceptor prepatterning and performs this function independently of the BMP signaling. The correct levels of sox2 are critical for the functionally important asymmetrical positioning of the parapineal organ and for the migration of parapineal cells as a coherent structure. Deviations from this strict control result in defects associated with abnormal habenular laterality, which we have documented and quantified in sox2 morphants